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ABSTRACT 



Two problems have been addressed: 1) whethgr it is possible to bui^ld 
a question asking set in children, and 2-) whether the acquisition of 



a question asking , set will enhance reading comprehension. 



The objective was the development and validation of an instructional 
system for ensuring^ question generating behavior in elementary 
school- children. • ' 



iThe program was. tested with individuals^ groups, and entire classrooms 
l^ach tryout was followed by intermediate pi;ogram revisions. 

BoVh *criterion--ref erenced and standardized reading ^comprehension 
testNs were used to e^vaiuate the program effectiveness. * 



N 



The rejsults indicate that it is possible to build a question asking 
set in\children. The significant gains of the experimental groups 
on the Is t andatdi zed subtest demonstrate that training in question 
generatiiVg can enhance^ cc^mprehension . In order to correctly respond 
to. the s t antJardi Zed subtest, the student had to generate questions 
at various levels of complexity. The fact that the performance of 
the experimental groups on the standardized subtest impr'oved signifi- 
xantly may indicate that since the children were trained to refsppnd 
at l^wer levels^ they were capable of ,te6ponding to the constraints 
of higher level skills. 2 
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HfE PROBLEM 



Introduction ^ ' • ' - ^ 

Many educators agree tfhat developing questioning skills is an essen 

tial part of the .educational process. (Firch, 1880; Dale, 1968; Brethower 

\ ^ 
1969; Stauffer, 1968). As Joshua G. Firch wrote a century- ago: 

•'The- whole sum of what mjay be said about questioning is 
comprised in this: it ought to set the learners think- \ ^ 
'ing, -t9^ promote activity and energy on their parts, and 
to arouse the whole mental faculty-into action, instead 
! 'of blindly cultivating the memory at the expense of 
higher intellectual- powers (Firch, 1880, p, 1) 

" " - ' * . . , ^ v 

^ A similar view was expressed by Dale: . . 

''Schools do not usually teach the art • a£i-.questionirig, 
but expect students <,to develop skills in answering 
questions that. th.ey did not ask. We nee.d to help 
students to ask better questions... Education cannot 
be made interesting and^e?ffective unles's students 
keepuaskitig What? Why? and How? and they are en- 

— answers to their 



couraged and assisted t^) find goc^d. 
questional;''. (4kle, 19^8, p.^1) 



Despite sucK agreement and' the apparent^ absence of disagreement, 
only incidental data is available 'to verify the importance of ijuestions 
for learning. Rpthkopf (1966)^ Rothkopf arid "Bisbicos -(19,67) , and 'Frase' 
(1967) studied the effect c^f^question placemenx on learning. In these 
seve^ttt^studies, groups who saw a qti^ti^^ either b^ore qr after the 
reading'paasage retained ^ig^ficaritly mo^b^^in format ion 'han ;did control 
groups who did not see questions at all.- In none of. these studies were 
students Vequir^d to generate tlr^i-r" own questions . . ' ' 

If question-asking is a skill; then it 'shoul'd ba Amenable to in- ^ 
struction. Therefore, we may ask: - y''y ; -.r 



• 1.- IVhether it is possible to build a question 
asking set in children. ^ , 

^2. Whether the acquisition of a question asking 
. . set vJill have an effect on reading comprehension. 

■ ; ^ . ' • * 

si- " i 

In order to build a question asking set in elementary school students 
one will have to train children in the: asking of apj^ropriate^ kinds of 
questions. In addition, ■ children, mus^t^e trained to modify their ques- 
tions to fit tefxt material they must reformulate questions w^ile they 

read. . In other words, children must be able to: 

/" • - i - o V 

1. Transform statement^s4nto questions.'^/ 

2. Initiate reading with a~^eX of questions,, then 
reformulate' the Questions on the basis of textual 
constraints . " . 

Literature ReView " • 

The literature on questioning in reading may be grouped u^der two 

major headings: (1) characteristics -of questions which influence learning; 

(2) definition^ of reading comprehens'ion. ^ 

1. Characteristics of Questions UTiich Influen^ Learning 

Two characteristics' of questions have been of interest to investiga-. 

tors: (a) tbe type of cfu^stion; (b) its .position in the text. 

a. The Type of Questions Asked • 

Studies by Frase (196a) , Rothkopf an,d Bisbicos (1967) , and Morasky \ ^ 

(197cf5, have indicated that s^tort term retention of both relevant "and .in - 

cid'^ental information was higher With specific questions than witli^ general 

.questi-ons. « ' ' i . " , 

Morasky (1970) studied^the effect of op^en-ended' (general) question's 

Qn incidental and'relevari^leaming ^fromVritteri materials; no signifi- 

cant di-ff^rence^ccurrea b€ttw6en mean recall scores for incidental >and 



relevant questions\ Morasky interpreted .this result in the followi 



"...Mpre important perhaps is the possibility that 
subjects not only do not make an overt re^iponse to 
- open-ended question^, biit that 'they might 'not even 
make a covert response,. Such a situation would 
mean that an hypothetiQal answer could not be gene- 
rated, . .Without a. . .hypothetical answer in storage, 
the subject could not' efficiently use a matching 
strategy . .\An alternative^ , .strategy would be^ one 
in which'the subject attempted' massive storage of 
information. . .This is similar to what a subject at- 
4:empt^ when questions ^re not used with written 
material. 'J (Morasky, 1970, p. 10) * 

Other than studies of specificity-generality of questions, little 

"research has been done concerning the effect of types of question-s oji 

reading comprehension. . . ^ ^ . 

Watts and Anderson (1971) (as cited in Anderson 197Z)_„argued , that 

\ I — i O 

insert^jfl questions which required comjfehension woftfld'^ induce meaningful 
^ocessing of text, and thus, improve performance on new criterion test 
comprehension questions. High school seniors answered a question after 

reading jeach( of • five passages explaining a psychologital principle. This 

■ ' ' . * ■ 

study has shown .that groups which received inserted questions requiring 
them to apply the principles to new examples performed significantly 
better on the post- test than did all other grouppl including groups which* 
received insertec^uestions that repeated examplep described in the text. 
The group which answered verbatim name questions^ performed worst on the 
postrVst , poorer even than the reading only control, group. A possible 
e^cgj^nation of improved performance* on new questions for the first groups 
is that a question which follows a paragraph may influence information 
processing skills on the passage which follows it; it. may contain a hint^ 
of whatScfttegory of question will be .'asked following the next- passage 

hencl^^.wii}^ elicit the app^rbpriate processing skills. Thus, answering 
inserted comprehension' questions' maintained and shaped information process 
ing skills which were relevknt to the post-test. IVhAreas, for the other 



groups, answering' inserted] questions ^which. entail- verbatim recall ^main- 

tained aitd shaped information processing skills which were i^ielevant 

to. the post-test. ■ ■ ' . 

* ■ ■ •■■ . ». ■ ' ■ ' \ 

The "important implication from the above study is that, in ordehr, 

to utilize question-asking as a technique for enhancing comprehension^ 

one should construct questions that assuredly require comprehension. 

Bloom stated tha^:^ 



".^.the main task of "the education^rocess is to « 
change the learners in desirable, waiys, and that it. 
A is the primary task of teachers and curriculum i - 

makers to specify in precise terms the ways in • 
which students^'^will be altered by the. learning * « 

process." (Bloom, 197i, p.' 17) ^ ' / 

If one accepts this position, then quo-'stion^^^esented to students 
should stem .from^ the educational objtedtives . 

Bloom. and his as-sociates (1956") defined educational objectiyes in* 

terms of 'levels of iognition. They distinguish -between knowledge, rfom- 

prehension, and other categorie^^ Knowledge was'defined as '4ittle more 

^tVian the rdbembering of the ide^^* phenomena in a form very, close to - 

that in which they were originally enoountered" (pp. 28-29) whereas 

^ ' ... 

comprehension* refemed^^tj) "u^ of the literal message, con- 

tai^ned^ii^ ^ a cq Tumun^atipn'* (p. 89) . CompreherisioHf was to be/infeyred 



from the capacity to deal with an '^bstraciion"^ in a form 




somewhat dif- 



nt from that in which it was ^originally presented. 

The questions^ i£§ed in- most of the matheiflagenic research dealt on^ly 

\sj4th the lowest level of learning -- knowledge. What is needed is re- 
I ^ 

search utilizing questions controlling learning on ail levels of cog- 
nitiort. y - ' - 
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b. Rpsition of que^tidb ij\ "^xf 

. - • I ^- ■ - ' • * - ' , r - \' - . / \ ^ : ' " ■ ' 

Trie position, of- c^uesti^^n^s ffeiatiye to the related content appears to 

' * • ' ■ "^"x^ " " ' * ■ ■ * 

be a determinant of reading bel(^idrs..,Ri^tiakopf (1965) inserted questions 

in ordinary text either before dr after the material to which* they re- 

lated. He determi-ned how much readers learri from the text to which the 

' ^ ^ - / ■ ^ ' " " ' ' . ' ' 

adjunct question relates (t{}e relevant ^nforraatioR) , ^nd how much they'! 

leam from the text which . is not related to those questions (the" inciden- 

tal information). Imgeneral, he found that subjects leam most when the 

quest ions;:come after the materiafl ^to which they relate. This finding 

was replic^te^everal times (Rothkopf, 1966; Rothkopf and iisbicos, 

1967; Frase,' 1967) . ^ ' 

The replication studies i^evealed that questioned groups, in comjjarison 

to control groops^which did not see adjynct questions, retained morfe of ' 

'the question- related mateiUai; Post-question groups rietained somewhat ^ V 

more incidental infoynation, but the pre-questi^dn groups retained reXative'r 

] ' ■ ^ ' ■ ■ " ' ' ' ■ ' ' ' V o'- 

ly little incidental information. In some cases (Frase, Patrick and 

Schuiraner; 1970), groups that saw questions before reading the passage " ' ' A 

% tended to retain less inci3en.tal informajtion than control groups which, , • 

did not read the question. " > ' ' ' Vv V/ 

Rothkopf has 'argueld that questions asked during* the course - of a f i, ^ 

lessoB njaintain ^nd shape the student's attention and probe's s^tng^^- ■ ^ * ' 

what Rothkopf calls ^mathem^genic behavior!'. . . ' -^i- 

; ■ --t. \, ■.. [ .'■ ■' ' ' -f^ . \' ' ^ • . V * . ^ . 

, ' . Iq all of this ma themagenic research cited above A "Icatning'* from 

* . •' J-' . !' ■■' ;■■ -^^'l ■ ¥ '. - ' ■ ' *;'v' •• ' 

/ . text mateViaJ- is/!ne:&s'uted" by./the. a^^ of-factual information w 14^^ : 

^ ■.•■>■■•■■■• • ^ -j-"^' . ■ \' . - . >i.;:.\;j''.-a 

: (reJcvat^t Jhd Jincidental) ^. T^^ mbst, of Itfre'' questions' eir?)loyed in ' V 

•*« ■■ . — . *' ^-.^^s^^--*' - '■' : . •.^*'' ' ' '" ' ' ' ' ' 



these studies have tie'^ted" ve'rbatim..recall, Jh studiee^mploying another • \ 
criterion, ..different /e^.ts wert obtain^^dv ' {" >^>^/-. r^rJ\ \** .> : ' 



f .: 



Morasky (1970'; 1972) studied the effect of question pUcement (i.e., 
before after^the reading paragraph) on eye movements -and on reading 
time. The results of these ^udies indicate that placing aquestion 
before the a$lociaild information reduces both paragraph reading time 
and the numbjer of eye moveiient regressions. 

These* studies suggest that, subjects viewing questions b'efore para- 
graphs were behaviprally more biased (and, perkaps, more efficient) than' 
the subjects viewing questions after paragraphs. It is possible that, " 
when a question is placed^ ^fore the passage, a matching process occurs 
which aids subjects in id^tifying relevant information. Wi#h questions 
following paragraphs, the subject must attempt massive storage of ijj^r- 
mation for subsequent recall whea the question is presented. .The redun- 
dancy provi eye movement regression should facilitate extensive 
information storage, whereas the specific search associated with^a 
Hatching task should make redundancy less necessary. 

Other studies (Holmes, 1931; Stein, , 1952; Anderson, 1971), have 
demonstrated that subjects who saw a question before reading attained 
higher scores on a reading comprehension test (given iSmiediately after 
readijig and then two weeks later) than subjects who saw no questi'ons but 
who read carefully and reread the same passage. 
^2— Definitions of Reading Conpreh 'dhs I on 

The terra '•^efinition" is not used here in its formal sense; it is 
used to indicate conceptualizations of the reading process as they are 
reflected in the literature. / 

The literature on reading comprehension (often the term "readipj?" 
is used synonymously) usually fall into two categories: 

a. Studies in whi^ reading comprehension is concep- 
tualized as a **product'\ 
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b. Stuiiies in which reading comprehension is oonceptualized J 
as A **process*'.^\^ 

a* Reading comprehensio^ks a "product". Studies in this category at- 
teroptt td identify the separ'ate>&kins comprising reading comprehension. 
/Their defihitions of reading comprefjension fall at various position^ 
; along a "specificity ^ generality" continuum (Ranking 1962) . . Some in- 
vestigators (§ond et al, 1960;-Strang et al, 19S5) imply that "reading' 
consists of a larg« number of separate^ specific skills^ while others 
(Davis, 1^4; Langsam,^941) imply that- it consists of a relatively 
small number of factors. , *^ 

Perhaps the extreme in "specific^ definitions is provided by 
Burkhart (1945) who found tl^ftt "...reading is not a single act, but 
is a tomplex fctivity made top of at least 214 separate abilities..." 
(p., 439^,- 

>When factorial analysis techniques are applied to reading test 
results in. order to determine the fundamental iompon^nts o# reading 
compreheqs only a small number of skills is identified. Langsam 
(1941) has ideiitified two comprehension factors "vocabulary" and 
"seeing relationships". Davis (1944) found six fund^niental factors 
as being statistically significant, but two factors "word know- 
ledge" and "reasoning in ^reading" accounted«for eighty-nine percent 
of the variance. Hunt (1957) reanalyzed Davis' data and reported 
finding ^'f^ two factors. ^ • 

Holmes (1965) applied statistical treatments to data obtained 
from the results of over fifty ^^sjs administered to high school 
students. Word meaning accounted- for 32 percent of the differences 
in reading power. Verbal analogies and listening coinprehension 
accounted for another 32 percent. Twenty- five petcent of the re- 



8%. • 

maining differences were unaccounted for. 

f^st of the factorial studies agree on the importance of the 

- 

•'vocabulary*' or **word meanings, and the ''reasoning factor" or 
••seeing rels^Eionships*'. The finding of these studies are, to some 
* degree, a^tfunction of the number and particular type of tests used 
and the,;Xerminology used b/ different investigators to describe their 
findings . ^ 

b. Reading comprehension as a "process". Studies in this category 
^ are concerned with the analysis of the ong^ng process or comprehension. 
Holmes (1965) proposed the theory that different centers of the 
brain store information received in visual, tod^tory, and kinesthetic 
fcrrms. These coded images are collected during reading throu^ three 
^levels^of subabilities which interact with each other in hierarchical 

fashion. The product of this interaction is Reading Power (comprehension). 

■fit 

According to another theory (Neisser, 1967; Rothkopf, 1970; Anderson, 

■* ■ ^ * .. 

1972) elements of text are first encoded in terms of perceptual futures 

(orthographic encoding). /The next level of processing involves acoustic 
features (phonological encoding). At this stage, strings of words are 
^translated into implicit (or explicit) speech. Finally, there is a 
semantic encoding, that is, the person may bring to mind meaningful 
representation based on words he sees. A person must be able to co- 
ordinate the ''surface information** embodied in the orthographic and 
phonological codes in terms of linguistic rules (Chomsky, 1965) in order 
to arrive at a proper semantic encoding. 

Research on memory provides some evidence#supporting the encoding 
theory. Most errors in short-term memory arise from confusion between 
sounds even if the stimuli are presented visually (IVickelgren, 1965; 



Hintzman, 1967) . In long term memdry, errors attrfbutable to confusion in 
Ineaning are much^more cprnmon than errors- due ,to acoustical coi)fusion 
(Baddeley, 1966). Tliese data su^geft th-at a printed verbal stijnulus 
is usually phonologically encoded and th^, if it is to be remembered 
for more t+ian a few 'moments , it is semantically encoded. A study hy: 
Bobrow (1970) indicated that when skilled^readers learn from written 
text, ordinarily they ^store- meanings rather than strings of symbols 
or speech sounlfs. . . ' ' - * * 

.We do not yet have* a/complete model pf what a person .has in his 
mind when he comprehends a communication. One theory^ that meanings - 
are represented as mental images (Paivia,, 1969) . It Seems impossible 
to explain comprehension of,abstract terms suc?^ as "truth" thrdugh the 
use pf the imagery theory. Similarly, it is difficult J^o explain the 
comprehension of terms depicting an entire class of thinjgs« For in- ^ 
stance, 4|flft^i$ no general image of the entire class of things called 



''f lowers*\^^m Tmage can .b« fc^rmed of jL "rose" or a "tulip", but an 
image, of a particular flower cannot represent the properties of th'e 
whole class. 

Another'' theory holds that when a person comprehends a. word, he 
brings to mind (not necessarily consciously) a complex of distinctive 
features (Collins andl Quillian, 1969). For example , "under "hammer'' 
a person stores only/the attributes distinctive of hammers. Charac- 
teristics of all tools are stored under ''tool". 

Most of the above theories are incomplete yet. hliat is needed is 

V ■ 

a model that wi 1 1 . describe in greater detail the component parts of the 
comprehension process artd how they function in the ongoing {Process. 
This model will guide the tonstruction of teaching materials. Semmelroth's 
conceptual izati(on of the reading process provides such a model. 

16 ' 
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Theoretical 'Framework 



t 



The theoretical framework for this study is^a^d on Semroelroth's 



definition of reading. He ^defines reading asj , 

" . . , i^formaXion processing* in which informaxiiDn .is cpncei 
as internally existing uncertainty in the. formof alter 
tives to be majchpd with sensory events (196^1 pi 29) 

Reading is conceptualized as a very active behavior fn which the 

reader, relying on past exj)erience,| spontaneously attempts to predict 

the visui 

'confii;m his predictions. Each segmej^t rea^ in a text activates Aji the 

reader's mind possible* altematiyeyi'esponses; as one reads thtifVs entice, 

David was' swimming in the . 

Arousal of the following alternatives might occur: 'river, l^e, ocean^ 

sea, pool. Each of these alternatives is a spontaneous ^attempt to pre- 

♦ ^ V t • 

diet a respbnse for the parts not read yet. , .: <k- 

According to Seramelro'th, uncertainty (i.e^-, infprmation^) risers 

to the predictability of an event; the .greater the predictability of * 

an event, the less uncertainty it contains. 

The statement is illustrated in the following two examples-. 



A 




ince,| s 

what the written text should be, and. uses the visual infoiTnatj|m to 



High Uncertainty Low Uncertainty 

( low predictabi li ty) . (high predictability) 



1. The boy , was sitting 2. In the classroom, the boy 
at the . / was sitting ^at his 



1 



Tlic term ''information" as used in information theory, refers to the pr 
dictab;lity of an event ^ A random series of events contains more infor- 
mation than a non-random series . Thus, information=unpredictability= 
uncertainty. An organism is in a state of uncertainty when it "is faced 
with a stimulus situation to which it has^no appropriate response..: 
the primary motive force of organisms is the reduction of uncertainty/' 
(Smith, D.\£.P. , 1969; pp. 8-9) 

17 



In the first example, the^e are many possibly alternatives that have 
equal probability of occui5|^nce, e.g. stable, . desk, station, door, etc. 
-Whereas, in the second exaipple, the word "desfk" is highly predictable. 

Semimel roth points out*two important characteristics of uncertainty: 

"1) it reaches a maximum when all. of the alternatives in a situation have 

I, \ * ... 

e^ual probability iof occurrence" (1969, p. 2V). This wbulcf be the cas« 
for guessing, "head'' or •'tail"/in a toss of a coin. 2) "It increases 
as the number of possible altj^mativ^s increases^' (1968,* p. .27) • For ' 
instan^l^jj^ues^ing a nuinber of a throw of a die contains more- Uncertainty 
than guessi^ng- "head^' or "tail"' in- a toss of a coin^ , ' " < 

According to Semmelroth-, an input produces uncertainty 'within the 

: . ^ ♦ . • ' 

reader in the form of alternative^^. The alternatives differ With 

•A ^ ; ' 

•different readers depending upon the prior knowledge. and skill of the - 

readftf . For example, the ward "thinking", in a book title may raise in 

the novice reader alternatives in/ the form of words and letter shapes; 

the same input may stimulate in a philosophy professor altemativedgSin 



the form of guesses about differences in theories. 

The alternative internal states are conceptual i^zed by Semmelroth 
as' "simultaneously firing neural networks*' (1968, p. 29). Inf.ormatiori 
may be processed in two ways. - ^ - ^ 

1) "processing of information could refer to the choice of 

one of these networks through the interaction of sensory ^ 
stimulatipn (looking at the word on tlj^e page) and the - 
operation of the active networks.' This process can be *^ 
seen as a matching between the senSbry input and the 
j' appropriate network", (i.e., recognition) 

However, this concfition jnay not tajUR^^ce because an appropriate 

network has not been active. \ * ^ 

2) ''the initiation of fi^jrig in approrpriate networks so 
that^atching can taK^ {place*' . (1968, p. 29) ' 

18 
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For 'example, when reading the following sentence 
. David was swimming in the ' 



the reader tries to predict a response, thus stimulating uncertainfy- in 

form of alternatives such as: sea, I'i^^^j^^^ pool. One of these 

alternatives matches the word on the printed page. He reads, "David 

was swimming in the lake.'* His guess was confirmed (matched) by the 

printed, page, thereby 'reducing his uncertainty. 

f • 

In case of no' match between one of the alternatives generated and 

the printed word, the reader^may have to spinet some more graphic cues 

' and generate new alternatives. • i - I * 

• * ■■ * 

• This model of the reading process' implies that the ^ alternatives 

•» ^ • ^ * 

must exist in the reader's* repertoire, s^nce the arousal of altenva- 

ti.ves -is the reactivation of previously learned responses. The^alterf? 

* natives must also be classified or categorized so that the number of 

' » * *. 

ppssiblc alternatives can be handled efficiently. A-s BrethbWer says: 

*'lVe can conceptualize reading as if the reader has "stored" 
. (and qross-indexcd) many classes of outputs and many 
exefnp^^ars of each class. The inputs serve to guide, 
first^ selection of the class and then the selection of ^ , 
the exemplar of the class. The exemplar is then compared 
to the input and to general constraints on outputs to • 
se^ if it is* an acceptable output." (1970, p. 12) • 

IjCother words, the written material is used to first guide the 

generation of alternatives and then to discriminate whether the alter- 

native selected conforms to general linguistic Constraints and corres- 

-# 

ponds to the characteristic of the input. 

• « 

"It ij as if the reader 1) asks for each input 'What do 
I know .that relates to this?' 2) recalls (or generates, 
or actively considers) those related items, selecting 
anong them one which 3) matches linguistic constraints 
and characteristic of th^JLnput." (Brethower, .1970, p. 13) 




t 
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When processing info^rmation, the reader makes use of semantic 

and. syntactic cues. Syntax deals K^th the "rules by which sentences 

are ordered" (€mith, F. 1971, p, 28), whereas semantics is. concerned 

with the meaning of individual words and how these mean^Lngs are ^ut 

together/ The use of semantic and syntactic cues is illustrated in 

the*tfollowing exaiiple: ^ * 

".The'^rave ^ rode the white hoxse." ^ 

* • * 
the space can be filled only by a nqurib other alternatives (e^g 

"I ' y > 

verbs, prepositions) are eliminate^, because of grammatical xelati 



.gUjg^ax), iSome noAs 



among the elements in the sentence (i>e* jjagitax) • JSome nqms* such 





"table*^ must be ^^cluded hgHuse 
tttenw (i..^,^eman€ic^^^^^ ' V 



•'flower", "rpcfc'', "house*', "table", must be ^^cluded _^g|luse of the^sense 
of other words 



TJ|C?*W^f^^H^ up when processing his uncertainty are 

— ^ ' ^ 
not gatht^recri^ to right". \Vhile the adtective ''brkve'* elimi- 

nates somfr.^:^p^t8matives that*" could be substituted in the space that follows 
it, other alternatives are eliminated by the words that are given at the 
- end of rttfe*^ sentence. As Frank Smith says: » , . 

. "Information is available at every point to reduce the 

' • * number of alternaTtives remaining for those parts of tflie ^ 

sequence that have not been encountered," (Smith 1971, ^ 
p. 193) ' • 

\ This model holds that processing of information is continuous in a 

cyclic pattern. 



EKLC 
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llie cyclic process is illust^rated by the following diagram. 




Uncerts^inty 
Reduction 



Questioning 




Uncertainty 
Aroused 



Matching ^ 



L 




Searching 



Alternate 
States 




:*In summary, according to Semmelroth, two conditions are necessary 
for reading to occur: r 

1) the existence' of uncertainty within the reader in the 

t 

t form of active alternative responses; and 

2) *the reduction of uncertainty or information processing. 
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Domain of Questions « *. 

Generating questions ajid predicting answers before* reading stimulates 

uncertainty; the reader ca^encapsulctte uncertainty within que'stion re- 

quirements anA-reduce it by answering the question. Furthermore, process-^ 

ing'of uncertainty requires thgj^^jKT^tive alternatives are relevant to 

the material re5^^^Therefore,\t1i6 questions generated by the reader must 

>ly te rejrisj^d tp fit the passage. ^ ' . 

In order to effectively use questions as a means of controlling \ 

reading, one should be ablte to: • 

1. Transform statements Jja*o, different kinds of 
qUe^^tions . ^ 

1^ Initiate re^adfng "with set of questions, -and ^ 
then^ xefcpnujate the, qjiest ions as hj5 reads. 

Anderson (1972) and.^ormuth (1970) classify questj.ons into five ^ ^ 

classes, according to. the manner in which they are formed. ^' 

a, i Verbatim questions - in order to. form thp type of question^"A 
st^^teinCTit is taken in literal word-by^>wOr3^fjbrm from tlie te^t" (Anderison 
1972, p^. 149) and transformed int^ii question 

b. Transformed verbatim questions'- the form of a senteikre is somewhat 
changed by rearranging the order of its elements and applying logical 
and syntactical transformations. . ^ | 



1 ■ 

tence i< 



Th 



ese^two types of questions are illustrated in the\ following 



example^: 



Stimulus Sentence 


Question 


Type 


Dan rode a bike. 

a 


1. Did Dan ride a bike? 

2 . Who rode a bike. 

3. By whom was the bike 
ridden? 


Verbatim ^ 
Verbatim • ^ 

Transformed 
Verbatim 
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c. Paraphrg^e, questions r *'Tw6 statements are . defined as .paraphrases • 
•of one another if 1) they hav^Jjto substantive words* (rf^iins, verbs, modi-- 

fiers) in common, and 2) they are eqUivalen\ in meaning." ^(Anderson, 
19.72,' p. ISO) When generating a paraphrase^wiest ion, ohe uses synonyms 
of the original statem.ent. *\ . 

d. Transformed paraphrase quesi&^ms - ^'Questions* in this class' are made 
from paraphrases which have been' rearranged or transformed." .('Anderson, 



1972, p. 151) 



The. above two type's 'of questions are illus treated in thef^ following 



ex^mple^. CBormu.th 1970, p. 48) 



Stimulus Sentence 



:i^e 



The diminutive 
youth mounted 
the steed. 



Question 



1. Mho climl^ed on the 
horse? 

2. By whom was the'bbVse 
climbed on? 



Typ 



Paraphra^se 

Transformed 
Paraphrase 



e. Intersentence questions - these questions ask ^bout information 
"^signaled by the relationships bet^en sentences. "The relative position 
of sentences, paragraphs and so on, signal causation, sequence in time. 



T 



s^tfbordination, arra several other kinds of information." (Bormuth 1970, 
p. 53) ' . \ 

The questions falling in thi&^^lass can sometimes be referred to 
as inference questiorf^ They are illustrated in the example Below. 

(Bormuth 1970, p. 52) ' ^ . 

^ \ . 



Stimulus Sentence 


Question 


Type 


Joe sat under the 
tree. The air 
was cool . 


iVhere was the air cool? 

^ . 


r 

Intersentence 
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Although these five classes of question<> are arranged according^ to 

complexity of question generated, the basJrc form of question used in all 

* J 
classes falls into the who, wh6n, where, what. How and why category. 

The differende in complexity of question is in tex^s of thejj^||^er and 

kind of cues used, the amount of text needed to be processed in order " 

to answer the question, ''and the length df^ the tequired answer. 

■ - v.: . . / 

• A D.E.P. Smith (1969) classified questions into two main groOps : 

■ ■ . • •• •■ 

1. Definitional questions - questions falling int<^'this class^ ask about 
one or more parts of the main idea^(i.e., defifftftion) of the written 
material, (e.g. chapter, ^paragraph, sentence) These questions usually 
ask abolit the following parts of the definition: the top^e^of the 

mat*erial,'the class of the topic, the descriptibn of tHe topic, and the 

* / 

refevance of t^e topic. The following questions may ^e generated for 

each of these parts: . • 

\ . - . - • ■ . " ' \ . 

Topic Vfhat is the material about? 



class " What is a ^^eral name for the top^c? 

To what class ^oes it belong? ^, # 

Description What are the topic's characteristics? v 
How does it look? ^ r 

What^ are its parts and how do they work together? 

Relevance IVhat is it'i^'sed for? 

Why is it important? 

IVhat is its purpose? , 

2. Relational questions « these questions ask for the simi larities/ and/or 

differences between tw^definitions^jr parts of "two definitions. They are 

generated in the form of a comparison (Or contrast. 

lomparison How are they similar? , 



The definitional questions, ay defined by Smith, cut across all five 



itrast\ How are they different' 

efii 

c^ssificat\< 



categories of questions in the first classification (Anderson and Bormuth) 
UTiereas the relational questions -will p¥bbably fall in the ''intersent^nce 



^estion'* category as defined by Anderson and Brormuth. * ^ 

IVhen training chLi^en in thQ ^rt of questioning, one should start 
with the verbatim questions (definitional) and^ then prs^ceed to th^,more 
complex types of questions. ' 



r 



> 



/ - I 




/ 



r 
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■ ' ■ " ' \J ^ ■ ■■■■ ■ x' ■ 

LABORATORY PHASE: . pnOGRAM DEVELOI^MENT ' ' 

■■ , ■ ■, .V ^ 

Accord^g to the. analysis in Chapter I, the pi^e^ence unc'eVl^ainty 
1 within the reader is a critical condition in/tAe^ comiyrehensio^' pjljO^ 
The re^er gan use questions as a me^s ^of "en^psulating his uhcjer^ 
^ Vlii- order to do this, he needs 'practice in question, gener.ation., Therefore, 
I have designed i)r<)gr|l|j|ra in5t;r'uc€±bnal msLterials to give elementary . 
school s'tudeiks t^j^a^^i^g in generatiWmiest| 



Objective of Qftjj^stfepn Generating Pro 

The objective of the. question generating, progranf Reported in this 
steady is as JPbllows: r t 



Given paragraphs contai^jg^ basic vOic^^Brai^ an elements 
level, stud^nt§ will generatl^wo interroM^^^ of the- 

y hen, where, what, how. Why category for^each paragraph. 




The Programming Strategy # 

In the development of the questioA generating progrW, the pro- 
gfammer used the "lean programming"- approach. The majoi^ point of^this 
strategy is to.j;|i|fcli^e minimum teaching mater^^in the^^rly drafts 
and to start add^Jrg^ instructional materials as liie result of th^ analy- 
sis of student responses and reactions in >tfyouts. The program is 
thus approximated successfully, starting with an incomplete 'draft and ^ 
^filling it out where the tryout data suggest. David (£ Markle made 
tlve follcitfing comments about^he "lean progrimming" strategy: \ 



*\..the programmer who has the necessary courage, can 
admit that he really has very little knowledge of what 
his students need - hunches, to be sure, but little 
knowledge. It is, a short step' to using the criterion 
item sequence alone as a first draft, with no instruc- 
tion at all... this approach would not be useful in an. 
Irea in which the students had absolutely .no relevant 
behavioral repertoire. But typically, the student 
does have a relevant repertoire. The difficulty is 
that the programmer does not know what it is." 
(Mftricel, 1967; p. 2) 

What folljiws is that, when , developing programmed instructional ma- 
terials, one smarts with a lean framework of a program, sometimes con- 
sisting of only the criterion frames, anfB adds instructional material 
through a continuous process of trial and revision rwtil a desirable 
level of performance on the criterion it-ems is achieved. 

The early tryouts are carried out with individual students. The 
purpose of the individual tryouts is to get information about the in- 
5.tructional needs of the students. The program is not expected to 
••work" yet. The programmer observes the student as he W§tks. He re- 
cords the time for each item and any comments made by the subject. 
The programmer also watches for signs of puzzlement, boredom, or fatigue 
If difficulty occurs, the programmer explores the difficulty with the 
student using open-ended questions. 

When the investigator thinks that he has attained a workable in- 
structional program, he tries it out on a group of students represent- 
ing the target population. The goal of the group tryout is to determine 
problems whicji may arise in a field settijig. Group tryouts also 
provi.de additional information aboiit items needing further revision. 

The early stages of the laboratory phase^f the question generating 
program were carriedj>ut with individual subjects ranging in age from 

seven years five months, to ten years ten months. Each subject was 

* ^ / 

! 

27. 



observed carefully as worked and the program was revised on the bas\s 

/ 

of the studefil responses. 

• A description of the foui^main drafts and revisions of the program 
follows* 

t 

1. First Draft of Program ^ ' 

The development of the program started with construction of a 
criterion test. The test contained one paragraph and students we^ ' 
asked to write three teHllcfuestions for the paragraph. Analysis of 
student responses on the test showed that questions written by students 
fell into several distinct classes as shown in the following exaiqple. 



Stimulus Sentence 


Student's Response V 


Dan is riding a bike. 
— ^ 


1. Dan is riding a bike. 

2. Dan is riding a bike? 

3. Dan is riding a h^e, is he? ' 

4. Is Dan riding a bflce? 

5. ' Who is riding^ bike?j 



In rtepdnse (l),ythe student copied the stimulus sentence. In (2), 

a question wias' generated by changing the intonation and adding a question 

mark. In (3), the sentence is transformed into a ••yes** or ••no^^ type 

. ^SfiAXlQn hX ^QOVXi^g't^ auxiliary or 

the word •'have'', or a form of the word •'do^^, and a question mark at the 

end of the sentence. Iln (4), a ••yes^^ or ••no" type question is generated 

by inserting an auxiliary word at the beginning of the sentence. Response 

(5) is the desirable terminal behavior; one of the Wh words is used in 

forming the question. In addition to these five classes of responses^ 

♦ 

students often wrote questions which were not related to the paragraph's 
general topic or could not be answered by the paragraph. Another common 
error was the omission of a question mark. 
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This analysis confirmed early* assertions of the programmer that in 
order to generate the who, when, where, wH^t, how, why type quesTions, 
one should -make the followijig ba$ic ddscrimiriatftons: 

1 biscriminate between a question and a non-question, 
a. A question asks for an<answpr. 

2 Discriminate between a good question and a pooi; question. 

a. A good question starts with a question word. 

b. A good question asks about the material read. 

c. ^ good question can be answered by the material read. 

The next step was to arrange the above required responses- in a logi- 
cal sequence and to write the teaching frames for each step. The items 
used as foils (i.e., wrong answers) in the program were based on students' 
initial responses on the test. 

>rhe first draft of the program included two separate booklets. The 

first one (A) contained ten paragraphs. - The second booklet (B) was a 

r 

response book. It included six separate sections. Each section contained 
an example, a general rule, -and a set of ten frames, each pertaining to 
a different paragraph in booklet (A). 

The first two sections called for a recognition response. 

i 

Section I dealt with the discrimination between a question and a 
non-question. It presented 10 pairs of sentences, each pair consisting 
of one target and one foil. 

Section 2 was similar, but the discrimination taught was that 
between good and poor questions. 
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Section I 






A question always asks for an answer and ends with a 
question mark. 




• 


Example 1 






Read the paragraph below: 






The Mackinac Bridge is one of the most beautiful, v 






bridges^n our country. It is located in the state of 






Michigan and spans a body of water called the Straits of 






Mackinac. The bridge is about five miles long and 






connects the upper a^d lower peninsulas of Michigan. 






Each year many people come to Michigan just to cross the 






Mackinac Bridge. 




Circle the question below: 






1. Where is tHe Mackinac Bridge located? ' x 

2. The Mackinac Bridge is very long. 


« 


Answers ^is a question .because it asks for an answer and efids 




with a question mark. 




Read paragraph. A then cintle the question below. 






1. Why ax:p camels good desert animals? 

2. A cam^l can tx^vel a long distance.; 
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Section 2 * ' , 

m 


■ 1 


1 

' A good question for a paragraph is about the paragraph. 






Example 2 ^ ' 


•V . - 




Read the paragraph below: 


< 




^ IVhen you get a new puppy/ you should get it in the 






morning. Then, the dog will have a long day in which to 






get to know you. It is best if you can bring the dog 






home on a 'Saturday morning. Thi^ will give you a whole 






weekend to get to know the new dog. 




Circle the better question. * 






• > 

1. How much chocolate did you eat today? 




2 . Ijfhen should you get- your new puppy? 

4 


* « 

Answer: (2)is thebetter question because it is about the 




paragraph!.' ' v - 

• • 


Read paragraph A then circle the better question. ^ 




1. Where do.es an eagle live? 




2. Where does a camel store its food? 
t 



Sectioij 3 dealt with the discrimination between a good question and a 
poor one. It included ten pairs of questions, one target and one foil. 
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Section 3 



T 



A good question can be answered by leading the 
paragraph. 



t 

Example 4 ^ 
Read this paragraph. 



People have, always wanted to know what the' coming 
weather would be. Many years ago, mdn found that they 
could spme times predict weatKer changes by watching for 
signs in nature.^ Today we learn abcpt coming'weather 
from weather reports. These reportj( are based on 
weather news collected by more than 2,000 weather 

■ / 

st apion^all jover the world. | 



Circle the better question: 

1. Why did people' watch for $i^J^^in nature? 

■ ' h 

2. How does a weather statio^ collect weather 
information? , 

Answer: ^is the better question because it is answered by 
-the paragraph . 

Read paragraph- A then circle the better question. 

1. What foods do camels like to eat? 

2. KTiat does a camel store in its hump? 



Section 4 involved sentences with modified cloze exercises which taught 
discrimination between appropriate and inappropriate question words. 
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o6CLion H 




J • 


3. ■ - 


Read paragraph C , then circle the 


appropriate question 


word. 




Why/when is spipe like a clear. 


dark night? ' 



Section 5 d^alt with, discrimination between good and poor questions. 
It presented 10 pairs of sentences, one target and one foil. The last 
section called for production of a "good" question for each of ithe 
paragraphs in booklet A. 



Section 5 f 

J 

Read paragraph A^-, then circle the better question. 

1. Is the camel a strong animal? 

r 

|ni, 

2. Why are camels called "ships of desert?" 



Section 6 " ^ ^ 

Read paragraph ' A , then Write a good question for -it, 

\^ 

— 'I 



On the basis of student responses on the first draft of "the program-, 
the programmer realized that reading paragraphs prior to making the dis- 
crimination between a question and a non-question is superfluous. A 
similar problem occurred in teaching the discrimination between good and 

33 



poor questions. It was realized that when gen exat^^quest ions, 
^students transform single sentences into questions. TTierefore, the 
second dra€t presented those discriminations in relation to single 

/ ' 

sentences. . • . 

■ ' ..•■■■•4 ' . 

Frequent requests of students ia Section 6 of the draft to 
remind them- o'f the possible question words resulted in ah addition 
of a section which provided additional practice in using^jj^uestion 
vords. The other major revision concerned ^he criterioii^est . The 
paragraph used in the first draft did not contain- enough rotails ft>r 
the generation of three questions, therefore, it replflSfed in the 
second draft. . / 



2. Second Draft of Program 

The second draft also consisted of two booklets, one Xbn^ining 
ten paragraphs, the other containing^ the prograinined,;instTOctiQnal raa- 
terials. The second booklet included eight separate seotr^on^^ 

; ^ -L^ » • 

Sections 2, 4, 7 and 8 wete identical to SectTlJBis 3^3t| 6 and 7 

. . ■ ' " ' ' ^ V 

in the first draft. , 

The first section dealt 'with the discrimination beti^Kn a question 



• s 



and a non-ques'tion. It^presented .a rule, an e^mpl(^-and ten pairs of 
sentences, one target and one foil. * 
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Section- 1 , 



Aquestioa asks for an answer and ends with a question 
mark. 



Circle the question: 

1. IVhere is the Mackinac Bridge located? 
,2. The Mackinac Bridge^is very long. 

) . : - 

Answer: ^is a question because it asks for an answer and 
ends witj^ a question mark. 

Circle the question: 

1. )Vhy are camels good desert animals? 

2. A camel' can 'travel a long distance., ""^^ 



Section 3 presented a set of nine sentences, somje questions and some 
non-questions in which the question marks and periods were, deleted. 



Section 3 



Fill in the blank with a period or a questiop mark. 
Who gave the sandwich its name 



Section 5 included sentences with modified cloze^exercises Which gave the 
student training in discr|.minating between appropriate and inappropriate 
question words. 
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Section 5 

Refd this sentence: 






▲ - 

— . i 






i David climbed up hill. 






' y . ■ 

Which question is answered by the above sentence? 






Ci-rclerthe correct question word. 






When/who climbed iUp the h\ll? 






Answer: who climb ed^^ the hili? 






ij^l^is is the question answered by the sentence above 

■ - \ \ , • ■ ■ 




.« 


* . [-'y . ■ ■ ' . . • • 

Read this sentence: 






A camel can store food in its hump. 




'V ■ 

Ifliich ^luestion is answered by the above sentence? 




Circle the correct question word. 




Who/where c^ a camel store food? 

■ • ■ ■* ■ . - 





Section 6 was sipmilar, but the question word was deleted* 



\ Section 6 



Read this sentence: 



A camel is a pe^ect desert animal. 



Fill in the missing question word in the blank. 
• i s a perfect desert animal? 
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^ a result of student responses, several more major revisions were 

made. The draft presented two discriminations between a question anjd ^ 
non-question ,in the sdme SjCction, which proved to b*e too difficult for 
the loamers. Therefore, th? third draft presented only a single dis- 
crimination J.n each section. Few prompts reviewing, the rules were added 
to each section. Finally, the layout oXthe^ program was changed so. that 
th^ booklet was now 4-1/4" » 5-1/2", rather than 8-1/2" x 11", as it had 
been for the first and second drafts. ^ • 

3., Third Draft of Program ^ 

The third draft consisted of two separate booklets, the same as 
the first and second drafts. The response booklet included |^i|ie ^ 
sections. Sections, 4, 5^ 6, 7, 8 ;and 9 were identical to Sections 2, 
3, 4, ^, 6s and 8 in the second draft;. ^ - 

Sections 1, 2, 3 dealt with various discriminations between a 
question and a non-questioii. Each section presented a rule, an example, 
and eight pairs of questions, one. target and one foil. 
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U 1 UIl 1 






A question always ends with a question mark. 






Circle the question: ^ 






1) KTio wrote this book? ♦ ^ 




/ 


2) I' like this book very much. 


- 




Yes, is a question because it ends with' a question mark. 
Circle the question: . • ^ • 




1) How old are you? 

2) I have two brothers. 

m > ^ 





9 



^Section 2, Page 2 



A question always asks for an answer. 



Circle the ^^eijti^an : 



1) .Drivers use maps to find their way. 



2) How. are maps usefuj?" 







Sfecti6n'3' ' 




' \ 

y^k question usually starts with 
quest ioa words: 


one of these 






Who ^ iNThere 


How 






IVhen " What 


Why 






'. - ■ / ' 

Xircle the question: 








> 

1. Boats, float on^ wate*r. 






r 


2. *Who was Lincoln? * * 
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The third draft was tested in a combine,d third and fourth class iri 



the lakewood Elementary^School on the West side of Ann Arbor, Michigan. 
20 students participated in the study. The errors students made- on the 
program were tabulated in. the following table. Each cell depicta the 
nuni)'er of students who Aade an e^ror on the corresponding item. 

/ 

TABLE 1 ' I 

. ]' 
Summary of Errors Made on Third Draft of Question / 

Generating Program by 20 Third dhd Fourth Grade 

Students ' 





Set 


Sec 


S^c 


,Sec 


Sec 


Sec 


Sec 


Sec 


Sec 


# Item 


1 


- 2 


3 


-.4 


5 


. 6 


7 


8 


9 


1 


1 






* • 


1 






2 












3 


.5 


- 2 




& 




3 


1 






6 ' 




2 


1 


5 




4 


i 






1 


4 


3 




6 




5 








3 




8 


2 


10 


\\ 


6 


1 


2 


1 


3 




7 ' 


3 


10 




i 






1 


3 


5 




1 


6 




8 


' 1 


_5 


1 


7 




JO 


_'4 


5 




9 








3 


1 


4, , 




6 




10 








5 






. 4 


3 





As a result of the atialysfs of the errors made on the draft, the 
questions asked by students , and the teacher's comments, sevetal more 
major revisions were made. * ^ 
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' MailJ^uestiohs about words were asked by students; therefore; the 
..rVacabi^ary was completely changeil in the new draft. *The repetitive 
use of the same set^^ paragraphs throughout the draft proved to result 
in memorization of previous questions , thus interfering with learning. 
Therefore, in the fourth draft, new ^aragraphy' were introduced in each 
section. The paragraphs were worked into the bddy of the program 
rather than being compiled in a separate booklet as in the first three 
drafts. 

. " It seemed as if the errors in Section 4 of the draft steinmed 
partly from difficulty in vocabulary and partly from lack of practice 
in production^ tasks. Therefore, production tasks were added to Sections 
2 and 3 of thp new draft. ^ • ' \ " 

Analysis of the errors on Sections 5> 6 and 8 pro^yed' that the pre- 
sentation of the discrimination between ^ood and poor questions for 
paragraphs was too difficult for the learners. Therefore, ^wo' secf ions 
dealing with good que$.tions f6r sentences w^re added ta the fourth 
.draft; analysis of student responses oh Section 9 and ^he crit-erion 

' * ^ • * y ' " ^ ' * 

test provided additional evidence for the jieed of a more gradual 
presentation of the discrimination between good and poor questipns . 
(A special point system was devised for the scoring of respionses 'written 
in Section 9 and, therefoi^e, the errors are not summarized in Table 1.) 

An answer sheet was -inserted at the en^^ of each seegtion in order 
to provide immediate feedback to students. A self evaluation check 
list was provided at the end of Section^ 8 and 12. Another revision 
concerned the presentation of the general rules. In the fourth 
draft, the rule was presented on a separate page, facing the first 
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page of the section. Thisv^ras in lieu of the prompts include(M(ki the 
third draft. 

■ i 

4. Fourth Draft of Program 

The fourtfi draft of the program included six separate booklets, 
each containing two lessons. 

'The first three lessons dealt with discriminations between questions 
and non*question$. Each lesson presented a rule, an example, and seve- 
ral pairs (|f sentences, one target and one foil. 



Lesson 1, 



1^ 



Read A, then circle the question. 
A. 

1. Who wrote this book? 

2. This is a funny story. 

Yes, ^^*is a question because it ends with a 
question mark . 



Do B - P the same way. 
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Lesson 2, Page 5 








Put a ? after the question. ' 


) 

f 






h ' 


- 


A, 




1. What is your name 




2. I like to go fishing 




Yesj^^is a question because it 


asks for an 


answer • 




Do B - P the same way. 







Lesson 3, Page 8 

V 

Put a ? after the question. 



A. 

Boats fl«at on water 
2, How old is John 
Yes,^pis a question because it starts with 
a question word . 



Do B - P the same way. 
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The fourth lesson presented a set of sixteen sentences in which the' 
question marks and the periods were deleted. 





^ Lesson 4, Page 13 
Put in the a period or a 


- 




question mark. 












1. \4hat makes a car go 




1 






/ 
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Hie fifth lessQp tjiugJtf ttie lii 
questions for sentences. . 




nation between good and poor 




A. , 



Dan is riding his bike. 



1. What is Dan riding? 

m 

2. What color is the bike? 

Yes,^^is the better question because it is 
answered by the sentence . 



Lesson 5, Page 16 



Circle the better question for the sentence • 



below. 



Do B - N the same way, 



44 

ERIC 



38 



The teixth lesson presented a "fill in the blank"^type exercise, 
\ ♦ • 

providing practice in the proper use of various question words. 



i * Lesson 6, Page 23 

Write the missing question wotd 
in the . # 



• * 


* 


Jane read a good book. 









1. 



I 

read a good book? 



Yes, who read a good book? is the question, 
that is answered by the sentence. 



Do 2 - 13 the same wa^. 

7 

Lesson 7 provided a review of the discriminations taught in the 
previous sections . 
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Lesson 7, Page 28 

Circle the better questi-on for each sentence. 
(A T *1) 






-i— — ^ ^ 

A. 

• 




-* 


Cowboy Rick rides a white horse. 






1. Is Rick a cowboy? 

2. What does Rick rWe? 






^£=^ 





Lesson 8 presented a set of nine sentences and called for production 
of a good question for each of the sentences. 



Lesson 8, Page 33 
Write a good question for each sentence. 



1. 



A camel is a good desert animal. 



L 
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Lessons 9 and 10 dealt with the discrimination between good and 
poor questions for paragraphs. Each lesson included several paragraphs 
and a pair of questions for each paragraph, one target and one foil; 





Lesson 9 , Pace 36 


• * 




.Circle the better question for the story" 


• 


M 


below. 






A. 






The camel lives in the desert. 






He has a big hump on his back. 






1. When does .^ynuner start? 






2. Where does a camel live? 




Yes, is a better question because it is 




about the story. 
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Lesson 10, Page 41 



Circle the better question for the stfry below. 



A. 



Lisa has a red bike. David has 
a blue bike. , They like to ride 
their bikes in* the park. 



1. How old is Lisa? 

2. What color is Lisa's bike? 

Yes, is the better question because 
it is answered by the story . 

Do B - L the same way. 



EKLC 
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Lesson 11 provided a review of the .discrimination taught in the 

t 

previous two lessons. The last "lesson presented a set' of 10 short 
paragraphs and called for production of a good question for each 
paragraph. 



Lesson 11, Page 47 

Circle two good questions for the^story below. 

1 



A. 



^ There were different groups of 
Indians. Some were fishermen 
and .some were farmers. The 
Indians who lived in the 



plains were hunters 



1. IVhere did the farmers live? 

2. Wnat Indians were hunters? 

3. Where did the hunters live? 
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Lesson 12, Page 54 
Write one more question for each story. 



David lives near a lake, ^^£v/ery 
day he goes fishing. Today he 
caught seven fish. He decided 
to have a fish fry on the beach. 



1, How many fish did David catch? 



if 
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Criterion Goal 

'The pre and post t^st was divided into two subtests. 
Part I Criterion subtest included five paragraphs. The subjects 
were asked to generate two ''good** questions for each paragraph. The 
criteria for a good question were: (1) it» asks for an answer; (2) it 
ends with a question mark; (3) i? starts with a question word;\(4) 

it is about the paragraph; ^d (5) it can be answered by the paragraph 

i 

Part II Standardized subtest consisted oT one example and four pa 
graphs wj.th two questions pertaining to each paragraph. The litems 'ijn 
this part were taken from the Developmental Reading Tests-Bond^l^e^- 
Uoyt. Upper Primary Reading, Form UG- A, General Comprehension Section. 
There were a total of eight items in this part. 

The criterion goal was that ninety percent of the subjects in the 
experimental groups would achie.ve eighty- five percent accuracy on 
Part I criterion subtest of the post test. 





Internal Va^lidatiort Projredure — Pilot Study 
1 . Subjects ' ' 

The pre-test was administered to twenty-nine fourth graders at the 
Thompson Elementary School located in St. Francis, Wisconsin. Thirteen 
of these students demonstrated mastery by scoring eighty- fire percent 
correct or better (9 errors or less) on Part I Criterion subtest. 

The remaining eleven boys and four girls were used as subjects in 
the pilot study. The j:hildren ranged from eight years, ten months to 
ten years, 1 ^nth in age. 



51 



2. Procedure 

The fourth grade classroom tpacher administered the pre- and post- 
test^ and the program during the training period. The investigator 
observed the work session periodically. The subjects met in a small 
group at the back of their classroom to work on the program. 

Only instructions contained in the question generating program 
were read td^^^M2h«''^en, After going through the example for If 
Lesson 1 with^e teacher, the student wa^ able to finish the lesson 
on his own,^ The teacher then explained how to use. the fold-out 
answer sheet after which, the ^tudent was able to do each succeeding ' 
Wesson on his own;^ Teacher's aid was needed also at the end of 
Lesson 8 - self-evaluation check list. The teacher was instiycted to 
respond to student 's* questions about words by suggesting that the 
student try to figure it out by himself. If he could, not do so, the 
teacher was instructed to read the word and mark the^ difficulty in the' 
student's book for'^the investigator's information. However, the only 
questions asked by the students were questions abput' spelling of^^^^irtain 
words. The teacher was instructed to write the word on a piece of paper 
and hand it to the student. 

Each student worked on the program' at' his own rate, completing two 
lessons daily. Although the length of each instructional period was 
twenty minutes pjcKj^^y* some children completed their work earlier and 
returned to their regular seat. 

The fifteen students went through the program in six instructional 
periods (plus two additional periods for the administration of the pre- 
and post-tests), or about two hours of instruction time. 
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TABLE 2 . 

Error Rates of Fourth Grade Giildreil at Thompson Elementary 
School on Question Generating Program Pre- and Post-Tests 
/ , ' (Pilot Study) 





SUBTESTS 


:SUBJECT 


PART I 


PART II 


&RITE 


.RION^ 


STANDARDIZED^ 




PRE. 


POST 


PRE 


POST 


1 


» 

16 


6 


0 " 


'• 0 


2 


16 


0 


0 


0 


3 . 


16 


0 


2 


0 


4 


17 


" 0 


0 


1 


S 


19^ 


1 


1 


0 


6 


45 


1 


1 


1 


BOYS 










7 


22 


7 


1 


- 0 


, 8 


30 


4 


0 


.0 


9 


41 


5 • " 


3 


2 


■ • ,„ 










- = 10 


43 


0 


3 

1 


0 


11 


32 


0' 


0 


.0 


1 


X 28 


0 


2 


0 


2 


•19 


9 


2 


0 


GIRLS 










3 


16 


3 


0 


. 0 ( 


4 


25 


3 


4 


3 


MEAN 


25.7. 


2.60 


1.26 


0.47 , 


't 


6.768 


.1.914 


P 


.01 


N. 


S. 



Total possiblcisscore = 60 

2 ' ' 

Total possible score = 8 
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3. Evaluation • 

Upon completion of the program, the post-test (same instrument as 

the pre-test) was administered t.o the fifteen students. r 

As shown on Table 2, fourteen students (95 percent) demonstrated 

mastery (9 or fewer errors^ on the post- test of the critetion subtest. 

Only one student was below the satisfactory level. 

ThL ^ata ^ provided by the ^ilot study was u^d to< make some minor 

revisions in few itefhs in ^he program* ^ 



DENDNSTRATKW PHASE: EXTERNAL VALIDATION 

^ ■ c 

A summary of contents included in Chapter III of this study is as 
follows: 

The first section describes the procedures followed in administering 
the question generating program and tHe subjects used in the study. The 
second section of the chapter presents the results of the study. An 
analysis of these results is discussed in the third section. 

Procedure 

1. Description of Communities 

The study was conducted concurrently in two different communities in 
the Milwaukee area. The first community, the tjown of St. Francis, is 
located about 10 miles south of Milwaukee. This community is predomi- 
nantly white, working class, from a German or Polish origin. There are 
^ three elementary schools in the St. Francis School System. Thompson 

School, located in the east side of town, was used in this study. The 

f ■ \ ^ 

other community is located in the northwest side of Milwaukee. This 

community is racially flflxed; most families emm low-moderate incomes. 

Three elementary schools are located in this part of town. The North 

24th Street School was used in this study. 

} 

2. Selection Procedure 

The pre- test was administered to forty- six children in the two 
third grades of the Thompson School and to twenty-eight children in 
a third grade in the North 24th Street School. The pre-test was ad- 
ministered by the individuHl class teachers. Twenty-six children in 
these, classes demonstrated mastery by scoring eighty-five percent ^ 

•48 
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cofrect or better (nine or less errors) on Part 1 Criterion Subtest. 
The remaining forty-eight children served as subjects for the study. 

Subjects were assigned to experimental or control groups randomly 
within classes. 

The twenty-four fhildren in the experimental group used the question 
generating i^ogi-am developed by the Lnvestigatar,^^ The control group re- 
ceived no supplemental instructional m^erials. 

Descriptive data for sex, age, mean score and standard deviation 
on the criterion and standardized subtests for the three third grade 
classes (A, B, and C) are reported on Table 3- 

3. Administration of Program 

Prior to the beginning of the study, the investigator met with the 
three third grade teachers and the principals of the two "schools. Ex- 
planations of the procedures to be followed for the administration of 
the program were presented by the investigator- .Question generating 
program was provid^ to the twenty- four children in the experimenWl 
group (1 child,^ in experimental group B became ill, and was later dis- 
carded from the study). 

The experimental groups in two of the classes worked on the program 
at the back of their classrooms. The subjects in the third class 
worked on the program at their desks during a specified time period. 
One period of about fifteen minutes for six consecutive days was de- 
voted to the training sessions. 

At the first session, the classroom teacher worked out an example 
with the subjects, and explained how to use the fold-out answer sheet. 
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TABLE 3 



A Comparison of Sex, Age, ajid Error Rate on Question Generating Pre-Test for Experimental and Control 

Groups in Three Third Grade Classes (A,B,C) 

















• * 


SUBTESTS 


♦ 






Class 






SEX 


AGE 


CRITEH 


jON 


STANDARDlilD 


GROUP 


N 


M 


F 


X (MOS) 


X 


S 


t 


P 


"X 


S 


t 


P 














% 
















f 


Exp 


7 


3 


4 


99.71 


50.86 


19.94 






2.50 


1.87 






A 
















-.444 


N.S. 






1.52 


N.S. 




Cont 


7 


4 


3 


101.57 


34.86 


13.08 






1.14 


r34 




• 




|cp 


6 


3 


3 


100.50 


34.17 








1.33 


1.51 






B 
















.211 


N.S. 






.277 


U.S. 




Cont. 


7 


S 


2 


100.57 


32.57 


11.76 






1.14 


.90 






Exp 


10 


4 


6 


99.20 


43.80 


12.04 






2.30 


1.70 






C 
















.122 


N.S. 






-.419 


N.S. 




Cont 


10 


4 


6 


98.70 


43.10 


13.54 






2.70 


2.50 








Exp 


23 


10 


13 


99.74 ■ 


37.35 


15.10 






2.09 


■1.69 






TOTAL 
















-.065 


n;s. 






.557 


N.S. 




Cont 


24 


13 


11 


100.08 


37.62 








2.04 


1.93 






























\ 





Ages of subjects are as of Nov. 15, 1972, when the pfe-test was administered. 
Total passible score « 60 
Total possible score = 8 
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The students were then able -to work^-on the rest of the program on: their 
.own. 

Feedback on performance was provided by a fold-out answer sheet, at 
the. end of each lesson. The students were able to check their responses 
on the preceeding pages of each lesson. No record of errors was kept 
by the students or the teachers. 

The investigator emphasized to the teachers during the initial 
meeting that the question generating program was self-instructional. 
When a student asked for a spelling of a word, the teacher was in- 
structed to write the word on a piece of paper and hand it to the 
student. When a student asked a different kind of question, the teacher 
was instructed to first respond, "Try to figure *ft out for yourself." 

If the student repeated -the question, the teacher was instructed to 

^- « » • 

pronounce the word in question and underline it for the investigator's 

« 

information. ' ■ ^ 

The subjects in the control group received no supplemental iitetrue- 

tion. When th« experimental group was working on the program, Mie '{c^" 

■* . . . ' ' 

control group continued to do their regular assigned work aloag with 

the other children in the class. " . - . ~~ 

Results '^^ ^ ' ' 

The results of the \stlidy are presented in Table 4. On the critexion 
subtest, the mean number of errors on the pre-test for the ^^(perimental'^ . 
group was 37.35 and the post-test was 6.17, a difference sighi^i^anrt • 
beyond the one percent level. The mean number of erT^TS"'^ the ^je-te$t 
for the control group was 37.62 and the post-test jwas, 37.4^ showing no*;* 
significant change. ^ 



TABLE 4 - . 7 

A Comparison of Error Rates of Traiiied and Untrained Groups of third 
Grade Children on Two Subtests of Question Generating/ 
Pre- and Post-Tests ^ ^ 



SUBTEST 


GROUP 


PRE -TEST. 


■ POST-TEST 


DIFF. 


t . 




X 

ERRORS 


S 


X 

ERRORS 


■ S 


f 

Criterion 


Exp 
Cont 


37.35 
37.62 


15.10 
13.25 


6.17 
37.42 


6.28 
13.57 


31.18 
\ 

0.20 


10.31 
0.23 


.01 
N.S. 


Standard- ' 
ized 


Cont- 


J 2 !. 0 9 


1.69 

/1. 93 

> '■ 


1.00 
2.04 


1.37 
1.82 


.88 
.00 


2.39 


.05 
,N.S. 




.53 

On the standardized subtest, the mean number of errors on the pre- 
test for the experimental group was 2.09 and the post-test was 1.00, 

a difference significant at the five percent level. The control group 

k 

scored 2.04 on both^re- and post- subtests, no significant change. 

Table 5 shows the^ercentage of correct responses produced by 
subjects on the criterion subtest. The experimental group s'cored 
36.25 percent correct on the pre-test and' 86 percent correct on tl|e 
post-test. 87 percent of the subjects in the experimental ^roup 
(^Oi out of 23) demonstrated mastery by scoring 85 percent correct or 
better on the post-test of the criterion subtest, wherea§. the control 
group scored 36 percent correct on the pre-test and 37.5 percent on 
the post-test. No subject in the control group demonstrated mastery 
on the post-test. ^ . " 

On the standardized subtest,, the experimental group scored 74.5 
percent correct on the pre-test and 88 percent correct on the post-test. 
The control group had 74.5 percent correct on the pre-test and ^4. 5 
percent -correct on the post-test. 

A graph showing the percentage of correct re*5ponses is shown in 
Figure 1. 
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TABLE 5 



Percentage of Correct Responses on Two Subtests of Question Generating 
Pre- and Post-Test of Trained and 'Untfained Third Grade Students 

r 







EXPERI^ENTAL 


CONTROL 






SUBTESTS 


SUBTESTS 






CRITERION 


STANDARDIZED 


CRITERION 


STANDARDIZED 


GROUP 


STUDENT 


PRE 


POST 


PRE 


POST 


PRE 


POST 


PRE 


POST 




1 


28 


92 


62 


75 


40 


38 


88 


75 




2 


0 


57 


45 


62 


60 


52 


62 


75 




3 


58 


100 


88 


100 


28 


45 


^ 100 


75 


A 


4 


73 


90 


100 


100 


38 


25 


62 


50 




• 5 


60 


87 


75 


75 


8 




88 


88 . 




6 


48 


87 


88 


88 


60 






100 




7 


37 


85 


50 


75 


68 


57^ 




88 




1 


72 




■in 


1 no 




48 




8R 
oo 




2 


40 


70 


88 


100 


7 


10 


75 


75 




3 


43 


100 


100 


100 


70 . 


67 


100 


100 


B 


4 


35 


100 


75 


88 


52 


55 


100 


lOtf 




5 


0 


93 


88 


100 


48 


47 


88 


75 




6 


68 


100 


100 


88 


52 


43 


75 


75 




7 










53 

•I 


53 


88 


88 




^ 1 


0 


90 


75 


62 


0 


0 


SO 


62 




2 


55 


90 


88 


100 


60 


62 


100 


100 




3 


32 


100 


50 


88 


23 


0 


25 


25 




4- 


33 


90 


62 


88 


42. 


57 


7S 


75 




5 


0 


85 


25 


62 


0 


0 ' 


50 


■, 50 




6 


2 


100 


75 


88 


8 


25 


75 


45 ■ 




7 


32 


85 


75 


100 


15 


17 


12 


25. 




8 


28 


77 


75 


75 


32 


33 


100 


100 




9 • 


38 


93 


100 


100 


42 


42 


75 


62 




10 


50 


100 


88 


100 


60 


67 


100 


100 


Mean 


% 


36.25 


86 


74.5 


8S 


36 


37. S 


74.5 


74.5 


Total 
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FIG 1 : Percentage of correct responses on criterion test (Experimental group) 
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FIG 2: Percentage of correct responses on criterion tpst (Control group) 
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FIG 3; /Percentage of correct responses on standardized test 
^^--""^ (Experimental group) 
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FIG 4: Percentage of correct responses on standardized test (Control group) 
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Discussion 



'this study iiiis addressed to the following questioTis: 

1. ;Vhether i*t is possible, to build a question aski) 
set in children. 

2. Whether the acquisiti3h of a question asking set 
will enhance reading comprehension. 

The first question can only be partially answered. The progranuned 

instructional materials 'developed in this study trained children in 

— ■ > , . ' " 

generating the who, whenT^where,, what,Hiow, and wh^questions falling 
in the "verbatim questions" class. The significant gains of all the 
experimental groups indicate that it is possible to train children to 
generate "verbatim questions". However, further wprk is needed to develop 
instructional materials which will deal with the other classes of ques- 
tions before the first question can be fully answered. 

The results of this study support the contention that prograimned 
instructional materials are an efficient and effective method for teaching 
students to generate "verbatim questions". The significant gains of all 
the experimental groups show that the students benefited from t^e pro- 
grammed instructional materials. 

The* significant gains on the stanSardized subtest indicate that 
training in "question generating" can enhance comprehension. ^ In order to 
correctly respond to the standardized subtest, the student had to generate 
questions at various levels of compl^ity (e.g. paraphij^se, intersentence 
questions) .The fact that the performance of the experimental groups on 
the standardize<f subtest improved significantly may be important; it could 
be interpreted to mean that, since the children were trained to respond at 
a lower Level, they were capable of responding, • spontaneously, to the con- 
straints of higher level skills. This point should be verified with 
larger groi^ of subjects. >^ 
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The instructional materials developed by the investigator proved to 
benefit children with varying enterin^:^kills . As evident from the summary 
tables (pp. 54-56), significant gains have be6n attained by children who 
scored 0 points on the criterion pre-test as well as by children scorings 
up to 44 points. * 

These gains suggest that the question generating program can be ef- 
fectively used 

1. as supplemental materials for the teaching of reading 
in regular c^ssroom. 

2. as a remediation method. . 

The question technique as derived frdm the analysis of reading as 
•information processing has been used successfully with college students 
(Brethower^ 1971). However, not enough wori^ was do^ie to verify the 
effectiveness of the method with ^lementa^y school children. The success 
of the question generating^ program-sx^gests that the method can be 
applied to the teaching of reading in elementary schools. Indeed, there 
is a need to ascertain T^Wlnlnr of the technique at various age-grade 



levels 



In summary, the following aspects should be further explored: 

1. Development of instructional programs dealing with 
generation of highepj^evel questions. >^ 

2. Development of instructional mtiterials dealing with ^ 
other aspects of the reading process (e.^. generation 

' of alternatives) . 

3. Verification of the value of the questioning techni- 
que * at various age-grade levels. 
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The Pre- and Post-Test 

a. The Criterion Subtest, pp7 60-62 • 

b. The Standardized Si^test, pp.' 63-65 
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APPENDIX A 



ERIC 
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ERIC 



Write two good questions for story A. 



A. 



Johi anlAnn live by t lale. 
John and Ann have their own 
snail boat. They like to row 
the boat on the lake. 



1. 



2, 



Do B - E the sane way. 



V 



t 



Joe has a dog his name is 
Chtrlie. Iliis dog can do 
tricks. He can stand on his 
hind leg^* Khen Joe th^OKS a. 

stick, Charlie runs ki bilngs 

* 

it back. 



1. 



2. 



lb 
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c. 



A nan was carr]ring a heavy box 
on his back. He could not climb 
a hill. The box was too heavy. 
Two boys caae along and helped 
the man carry the box up the hiU. 



1. 



2. 



D. 



David and John went' fishing. 
David caught a big fish. John 
caught an old shoe that was 
In the^jO^e. This made the 
boys laugh. 



1. 



2. 
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E. 



Sandy likes to help her nother. 

f ' 

After dinner she puts the dishes 
in the sink and washes them with 
soap 'and water. Then, she cleans 
the table and sweeps the floor. 



1. 



2. 



• 



kin 

i 

r ' 



■ t 



0^ 
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.ReiWfStory A.;^ ciftle tke words that 



' , answerft,the two^^questi^j^. 

i 



I * 
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aiBBuna 



Billy\had something. 

Ann said, "What do you have?" 

"It is a boat," said Billy. 



1. Billy had a 

■ M ■ n ^ _ 

here ball boat said 

2. "What do you have?" said _ 
what Billy Jane Ann 



Do B ■ E the same way. 



B. 



Tim lives on a farm. He sells 
his milk to the dairy. The dairy' 
puts the 'milk into botfles and ^ 
sells it in town. 



1. Tim sells milk to the 
bottled dairy farm cows 

» • 

2. Tim lives on a 



bam ' dairy town farm 



Soie men sail far out to sea 'in 
little boats and let down their 
nets. When they pull up the 
nets?! they have thousands of 
tiny sardines. It is bad to 
catch too much because the 
net breaks. 



1. Sardines are caught by 



boxes nets traps hook^v 

2. Too lany fish lake'the nets' 
break stop drop slide . 



D. 



Both sides of the big-e^yon 



were coverd with trees. The 



stream at the lottoi of the 



canyon looked small. It was 

really a large stream. It was 

.' ♦ 

just far away. 



1. The canyon had trees on two, 
miles sides stneams lajiies 



2. The stream was 



big small slow blue 



One night (a policeman found a 


• 


little boy witJi a dog. "Where 


• 


do you live, young man?" asked 




the policeman. The boy wpuld 




hot talk. Then the policeman 




noticed a tag on the dog 4 




collar. "Frisky, 2153 First 




"^tieet," read the tag. 





1. The policeman probably took the 
boy 

home downtown to school to church 

2. Ffisky was lie name of the - 
dog str^ girl policeman . 
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APPENDIX B 



Sample Pages from Fourth 
Draft of Question Generating Program 
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Lesson 1, Page la; the general rule 



Lesson 1, Page \_ 




kcaJ A theoi circle the (|Ucstion 


« 


f 








1, Kho vrotc this bool? 




2, pill is 1 funny iiory. 

) 




Yei, (D Is 1 question because it ends^ 


t 


question lark. ^ 




bo 1 • F the sue viy, 






• I Him old 'il Tilt i 




2. 1 hive tvo brother], 








c. 




1. Jil Hies to en candy. ^ 




2. Vhat ire you eating? 
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Lesson 8: self-check mm sifeet 

4 ; 



r 
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Usson 1: fold Aitaiswii' sheet 



» h 



\ ^ 

Lesson I - 
, Ch^cl your questions. ^ 

Put l/ in the boxes bdOK 

I * 

r * ' 

If thi question: ' • . 

1. tnds kithn ' 

\. Stirtsvithi 7 vo[d. 

]. It iflji^erei) b/ ^ct| 





' 1 . 

t 




> * 
' is it insured 
by tl^e stor/l 


I 








2' 

. 3 






< 






* 


4 






•J. . f 


, * ■ 

t 






"""r— 


6 








; 








1 










r 




f 



I.* 8i 

Mi 
0. A 

|7. 0 



f 

Ussofl 1 



1 . < 




c. 0 



^1 
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